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Abstract 

Introduction: Technological innovation requires the laboratories to ensure that modifications or incorporations of new techniques do not alter the 
quality of their results. In an IS0 15189 accredited laboratory, flexible scope accreditation facilitates the inclusion of these changes prior to accredita- 
tion body evaluation. A strategy to perform the validation of a biochemistry analyzer in an accredited laboratory having a flexible scope is shown. 

Materials and methods: A validation procedure including the evaluation of imprecision and bias of two Dimension Vista analysers 1500 was con- 
ducted. Comparability of patient results between one of them and the lately replaced Dimension RxL Max was evaluated. All studies followed the 
respective Clinical and Laboratory Standards Institute (CLSI) protocols. 30 chemistry assays were studied. Coefficients of variation, percent bias and 
total error were calculated for all tests and biological variation was considered as acceptance criteria. Quality control material and patient samples 
were used as test materials. Interchangeability of the results was established by processing forty patients' samples in both devices. 

Results: 27 of the 30 studied parameters met allowable performance criteria. Sodium, chloride and magnesium did not fulfil acceptance criteria. 
Evidence of interchangeability of patient results was obtained for all parameters except magnesium, NT-proBNP, cTroponin I and C-reactive protein. 

Conclusions: A laboratory having a well structured and documented validation procedure can opt to get a flexible scope of accreditation. In additi- 
on, performing these activities prior to use on patient samples may evidence technical issues which must be corrected to minimize their impact on 
patient results. 
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Introduction 

Continuous technological innovation requires 
the laboratory to deal with frequent changes in 
methodology and instruments. Some of these 
changes are motivated by manufacturer's im- 
provements. Moreover, sometimes they are pro- 
moted by set requirements, which depend on the 
clinical needs of the diagnostic test. 

According to Clauses 5.5.1 to 5.5.3 of ISO 15189 (1), 
accredited laboratories may modify methods. 
Such modifications require the accredited labora- 
tory to have a flexible scope of accreditation. The 
main consequence of a flexible scope and the ben- 
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efit to the laboratory is the flexibility to modify 
methods, validate the changes and apply them 
without having to ask the Accreditation Body for 
extensions to the scope as in the called fixed 
scopes of accreditation are required (2-4). 

Historically, accreditation has been based on so 
called fixed scopes. This system for defining the 
scope obliges that an evaluation of laboratory 
competence should be carried out each time when 
an additional activity is added to the scope, even 
where competence in this general area has already 
been demonstrated. 
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Under flexible scope, laboratories are allowed to 
include additional activities in their scope of ac- 
creditation on the basis that their competence has 
been previously demonstrated to the Accredita- 
tion Body, not only to carry out activities accord- 
ing to previously evaluated procedures, but also 
for the development and validation of them fol- 
lowing a pre-established system. 

Recently, the Emergency Laboratory (EL) of the 
Department of Laboratory Medicine, Hospital Uni- 
versitario La Paz, Madrid, Spain has renewed its bi- 
ochemistry analyzers changing the Dimension RxL 
Max (RxL) to Dimension Vista 1500 (Vista), both 
from Siemens Healthcare Diagnostics 9 . This implies 
some methodological improvements such as LOCI 
technology for the cardiac Troponin I, NT-proBNP 
and HCG measurements, C-reactive protein (CRP) 
by nephelometric assay and the possibility for cali- 
bration for enzyme quantification (5). As a result of 
the flexible scope accreditation and prior to use 
on patients, the laboratory always applies a valida- 
tion strategy. This is based on CLSI recommenda- 
tions to assess performance reliability and to grant 
the comparability of patient results (6-1 0). 

The aim of this study is to show how to perform a 
validation of an analytical system, in this case a bi- 
ochemistry analyzer, when it is introduced in a 
flexible scope accredited laboratory to guarantee 
their capacity of ensuring that the results are trace- 
able for each individual patient. 

Validation procedure involved evaluating the main 
analytical performance (imprecision and system- 
atic error) of two Dimension Vista analysers and to 
assess the comparability of patient results of one 
of them with the previous methodology Dimen- 
sion RxL. 

Materials and methods 
Study design 

The Hospital Universitario La Paz is a tertiary insti- 
tution containing four hospitals: the General Hos- 
pital, Traumatology and Orthopaedics, Obstetrics 
and Gynaecology and Children's Hospital. It has 
nine critical care units, four emergency depart- 
ments and some outpatient activities. 
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The EL receives analytical requests from all these 
hospitals. The laboratory has been accredited by 
the Spanish Accreditation Body (ENAC), according 
to ISO 15189:2007 since 2005. It was the first Span- 
ish laboratory to obtain this accreditation and also 
the first to have a flexible scope accreditation. This 
accreditation covers all the analytes that are avail- 
able in the EL. 

A rigorous procedure established by the laborato- 
ry before the technological change was followed. 
The whole process was completed prior to use on 
patient samples. The initial step was to evaluate 
the analytical performance of two Dimension Vista 
analysers (namely V-1 and V-2). Secondly, a com- 
parison was made between patients' results ob- 
tained using Dimension Vista and using Dimen- 
sion RxL Max. The analytical performance evalua- 
tion was made of the two Dimension Vista instru- 
ments and the comparison with Dimension RxL 
Max was made using only the results from one Di- 
mension Vista (V-1). 

The evaluation procedure had been based on the 
CLSI EP5-A2 document (8) for precision and CLSI 
EP-15 document (9) for bias estimation. CLSI EP9- 
A2 document (10) was followed for verification of 
comparability of patient results. 

Multiple reagents and calibrator lots for all tests 
and only a single lot of control material were used 
over the study period. All materials were handled 
according to manufacturer recommendations. 

Statistical analysis was performed in the evalua- 
tion software package StatisPro (CLSI) for the 
evaluation of imprecision, bias and total error at 
the medical decision levels based on tables pro- 
vided by Westgard (11). Biological Variation (BV) 
was used as the main acceptance criteria (12) fol- 
lowing the hierarchy established by the Stockholm 
consensus (13). 

Evaluation of analytical performance of 
Dimension Vista 1500 

The scope of this study includes 30 analytes that 
were analyzed in the two Vista instruments and in 
the Dimension RxL Max. Principles of procedures 
of each parameter are shown in Table 1 . 
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Table 1. Principles of procedures of Dimension RxL Max and Dimension Vista. 



Analyte 


Abbreviation 


Principles of procedure Dimension RxL Max and Vista 


Albumin 


Alb 


Colorimetric bromocresol purple 


Alkaline phosphatase 


ALP 


Substrate p-nitrophenyl phosphate 


Alanine aminotransferase 


ALT 


L-alanine with phosphate pyridoxal 


Ammonia 


Amon 


Glutamate dehydrogenase 


Amylase 


AMY 


CNP-TrioseCNPG3 


Aspartate aminotransferase 


AST 


L-aspartate with pyridoxal phosphate 


Urea nitrogen 


BUN 


Urease/glutamate dehydrogenase 


Calcium 


Ca 


Colorimetric O-cresolftalein 


Cholesterol 


Choi 


Cholesterol esterase, Cholesterol oxidase 


Creatine kinase 


CK 


Creatine kinase. Modified Rosalki method 


Creatinine 


Cre 


Modified Jaffe method. Non IDMS-traceable 


Y-glutamyl transferase 


GGT 


G-Glutamyl carboxy nitroanilide 


Lactate dehydrogenase 


LD 


Enzymatic lactate to pyruvate 


Uric acid 


UricA 


Uricase 


Direct bilirubin 


DBil 


Jendrassik-Grof 


Total bilirubin 


TBil 


Jendrassik-Grof 


Phosphorus 


Phos 


Phosphomolybdate 


Glucose 


Glu 


Hexoquinase 


Magnesium 


Mg 


Methyl thymol blue 


Triglycerides 


Tg 


Enzymatic 


Urinary/cerebrospinal fluid protein 


UCFP 


Red pyrogallol 


Total protein 


TP 


Biuret endpoint 


Potassium 


K 


Indirect potentiometry 


Sodium 


Na 


Indirect potentiometry 


Chloride 


CI 


Indirect potentiometry 


Lithium 


Li 


Colorimetric 


Human chorionic gonadotropin 


HCG 


Heterogeneous immunoassay Chemiluminescence (LOCI) 


C-reactive protein 


CRP 


Immunoturbidimetric Immunonefelometric 


Cardiac troponin 1 


cTNl 


Heterogeneous immunoassay Chemiluminescence (LOCI) 


N-terminal pro-brain natriuretic peptide 


NT-proBNP 


Heterogeneous immunoassay Chemiluminescence (LOCI) 



The selected test materials (Table 2) were refer- 
ence materials from human serum or urine in or- 
der to be as similar as possible to the clinical sam- 
ples. This quality control material was purchased 
from BioRad Laboratories Inc. (CA, USA). All of 
them were liquid, ready to use and they were 
stored and manipulated according to manufactur- 
er recommendations. Vials which have been 
opened for more than two days were rejected. 
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Pooled patient samples from plasma and urine 
were used to complete the study for some constit- 
uents. Their concentrations were set near medical 
decision levels. After centrifugation at 3500 rpm 
for 10 minutes all plasma and urine pools were 
separated, aliquots were made and frozen at -20 °C 
until analysis (5 days). Prior to use, following the 
laboratory procedure, they had been laid at room 
temperature until they had thawed out and ho- 
mogenized before analysis. 
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Table 2. Quality control materials and pooled patient samples. 



Table 3. Analytical quality acceptance criteria (imprecision, bias 
and total error) established by the laboratory. 



Analyte 



Study material 



Alb, PT,Chol,Tg, 
TBil, DBil, Phos, 
Mg, Li 

GGT, CK, ALP, ALT, 
AST, AMY, LD 



Liquid Assayed Multiqual (*) 



Glu 

BUN,Cre, UricA 

Ca, Na, K, CI 

cTNl, NT-proBNP 

CRP 

Amon 
HCG 

UCFP 



Liquid Assayed Multiqual (*) 
Assayed Liquicheck Urine (#) 
Plasma Pool GLU (V) 

Liquid Assayed Multiqual (*) 
Assayed Liquicheck Urine (#) 
Plasma Pool A, Plasma Pool B 
Urine Pool (V) 

Liquid Assayed Multiqual (*) Plasma Pool 
A and Pool B (V) 

Cardiac Marker Plus LT (I) 

Cardiac Marker Plus LT(I) Elevated CRP (II) 
Plasma Pool CRP (V) 

Etanol/Ammonia (III) 

Immunoassay plus (IV) 

Assayed Liquicheck Urine (#) Urine Pool 
UCFP (VI) 

(*) Assayed Multiqual levels 1 and 3 (lot number 45580) 

(#) Assayed Liquicheck Urine levels 1 and 2 (lot number 62880) 

(I) Cardiac Marker Plus LTTrilevel (lot number 23470) 

(II) Elevated CPR level 3 (lot number 35260) 

(III) Ethanol/Ammonia levels 1 and 3 (lot number 51640) 

(IV) Immunoassay plus levels 1 and 3 (lot number 40730) 

(V) Pool A (low concentration patients plasma samples pool), Pool B 
(high concentration patients plasma samples pool), Plasma Pool GLU 
(patients plasma samples pool), Pool plasma CRP (patients plasma 
samples pool) 

(VI) Urine Pool (patients urine samples pool) 

Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine amino- 
transferase; Amon -Ammonia; AMY- Amylase; AST- Aspartate amino- 
transferase; BUN - Urea nitrogen; Ca - Calcium; Choi - Cholesterol; CK 

- Creatine kinase; Cre - Creatinine; GGT - y-glutamyl transferase; LD 

- Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil - 
Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg 

- Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total 
protein; K - Potassium; Na - Sodium; CI - Chloride; Li - Lithium; HCG - 
Human chorionic gonadotropin; CRP - C-reactive protein; cTNl - Cardi- 
ac troponin I; NT-proBNP - N-terminal pro-brain natriuretic peptide. 



Laboratory acceptance criteria of analytical per- 
formance are shown in Table 3. Based on our 
former experience with Dimension RxL Max we as- 
sume the same criteria previously established as 
laboratory quality specifications. Imprecision and 



Acceptance criteria 



Analyte 



Biological variation Minimum 



Alb, ALP, Ca, CI, Cre, Mg, Na, 
TP, UricA 



AMY, AST, BUN, cTNl, Glu, K, 
Biological variation Desirable LD, NT-proBNP, Phos, Choi, 

CRP 

ALT, CK, DBil, GGT, TBil, Tg, 
UCFP 

HCG, Li 

Amon 



Biological variation Optimum 

P50 EQAP (*) 
Manufacturer claims 



(*) External Quality Assurance Program of the Spanish Society of Clin- 
ical Chemistry and Molecular Pathology (SEQC). 
Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine aminotrans- 
ferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate amin- 
otransferase; BUN - Urea nitrogen; Ca - Calcium; Choi - Cholesterol; 
CK - Creatine kinase; Cre - Creatinine; GGT- y-glutamyl transferase; LD 

- Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil - 
Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg 

- Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total 
protein; K - Potassium; Na - Sodium; CI - Chloride; Li - Lithium; HCG - 
Human chorionic gonadotropin; CRP - C-reactive protein; cTNl - Cardi- 
ac troponin I; NT-proBNP - N-terminal pro-brain natriuretic peptide. 



bias results should not exceed the respective ac- 
ceptance criteria based on biological variation es- 
tablished by laboratory (13-15). 

Imprecision 

After the preliminary familiarization phase (five 
days, 50 test per each parameter, 1500 patient 
analyses in total), the procedure was performed 
over a twenty day period. According to the recom- 
mendations of CLSI EP5-A2 document, the follow- 
ing steps were carried out per day: two runs of 
control samples material and pooled patient sam- 
ples were analyzed daily. There was a maximum 
delay interval of two hours between the analyses 
in each device. Each run consisted of two repli- 
cates. Analysis was conducted by using a different 
aliquot per replicate. The run was discarded if 
there was any problem in quality control, proce- 
dures or any operating difficulty. Between each 
run the order of analysis of pooled patient samples 
and quality control material were interchanged. 

To interpret the imprecision results different coef- 
ficients of variation (CV%) were calculated from all 
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data (repeatability, between-run, between-day 
and within-laboratory imprecision). Results are ex- 
pressed as within-laboratory imprecision per ana- 
lyte and quality control material and it was com- 
pared with the allowable imprecision established 
by laboratory 

Systematic error or bias 

Systematic error (SE) was estimated from experi- 
mental data obtained according to CLSI EP15-A2 
document. Data were compiled upon every ana- 
lyte and quality control level. Throughout this pa- 
per the term bias estimation is assumed to be 
equal to SE. 

To interprete the bias results, bias was expressed 
as the difference between the average result that 
has been obtained for each parameter and the ac- 
cepted reference value from a third party interlab- 
oratory quality control program (Unity Real Time 
software, BioRad Lab) and it is expressed in terms 
of percent difference related to expected value 
(%). As accepted reference value, the cumulative 
media of the peer group from the third party qual- 
ity control (BioRad Lab) was assumed (16). 

Depending on the test, the peer group included 
27-34 laboratories. The average number of the 
data included in the peer group was approximate- 
ly 7000, though it varied from one parameter to 
another. The minimum data for any test was 5000, 
apart from urea nitrogen (N = 1988, provided by 
13 laboratories). 

The obtained values are compared with the allow- 
able systematic error based on biological variation 
established by the laboratory as showed in Table 3. 

Verification of comparability of patient results 
with the previous device 

Forty randomly selected patient samples from the 
emergency laboratory, regardless of their clinical 
conditions were performed in two runs. Samples 
were analyzed in one of the Dimension Vista de- 
vices (V-1) and Dimension RxL on the same day of 
venous collection. 

Analyses procedure followed the recommenda- 
tions of document from CLSI (CLSI EP9-A2). Daily 
analysis of eight patient samples was undergone 
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over a five day period. Two replicates of the sam- 
ples were analyzed in the new device V-1. Later, 
within a 2 hour interval, the same samples were 
performed by the comparative procedure, also by 
duplicate. 

To interpret the comparability verification results, 
the difference between the current method and 
the candidate replacement is considered as fol- 
lows: Confidence interval of the estimated differ- 
ence should include the laboratory acceptable er- 
ror at the medical decision level. Total allowable 
error (TEa) also based on BV was considered as the 
criteria for comparison study. 

Results 

Tables 4 to 6 show the individual results of impre- 
cision and bias evaluation of the two Dimension 
Vista analysers. They are grouped depending on 
the compliance degree of each parameter. 

Table 4 represents all parameters which fulfil both 
imprecision and bias requirements in both analyz- 
ers. On the other hand, Table 5 highlights those 
parameters that do not reach the analytical re- 
quirement of imprecision or bias but they fulfil to- 
tal error objectives (TEa = Bias + 1.65 x CV). 

Analytes that did not fulfil any requirement are 
shown in Table 6. These analytes were considered 
to be in a special situation and were evaluated in- 
dependently. 

Regarding electrolytes specifically sodium and 
chloride, it is widely known that due to the current 
"state of the art" it is difficult to fulfil BV criteria (17). 
In fact, as a result of this evaluation, we do not 
reach the minimum imprecision BV criteria. Some 
actions were performed in order to achieve a bet- 
ter control of these parameters (such as cleaning 
system review, increasing maintenance protocols, 
water purification supplies review, etc). 

Magnesium did not fulfil all the established analyt- 
ical performance requirements. One of the devices 
had greater imprecision and the other showed 
greater bias than established by the laboratory as 
quality specifications. Therefore magnesium, as 
well as sodium and chloride, needed more actions 
to improve its performance. These included acting 
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Table 4. Analytes that fulfil laboratory acceptance criteria for imprecision and bias in both analyzers. 



Control Material 



Analyte 
(units) 


Quality control 
level 


QS 


Imprecision (%) 

CV 
V-1 


CV 
V-2 


QS 


SE (%) 

PD 
V-1 


PD 

V-2 


ALT 

(U/L) 


175 


6.1 


1.74 


1.2 


6 


-2.01 


-3.7 


AMY 
(U/L) 


322 


4.4 


1.6 


1.14 


7.4 


1.16 


5.47 


Amon 


32.13 


10 H 


9.93 


6.6 


10 


8.19 


6.76 


(umol/L) 


366.28 


1.6 


1.14 


(*) 


0.71 


2.93 


AST 

(U/L) 


240 


6 


2.89 


1.25 


5.4 


-2.04 


-2 




H. 1 o 


7(#) 


Z.J/ 


4.UO 


7(#) 


?i 

J.Z 1 


C C 
-J.J 


(IU/L) 


376.28 


5.51 


6.1 


1.21 


-2.85 


Rl IM 


1 U.J 


6.2 


j.jy 


j. 1 1 


5.5 


n 3Q 
-u. jy 


-z. IZ 


(mmol/L) 


50.34 


1.95 


1.44 


0.22 


-1.83 


Choi 


2.64 


2.7 


1.75 


0.91 




-1.6 


-2.45 


(mmol/L) 


5.44 


1.6 


0.83 


4 


-0.42 


-2.45 


cTNl 

(ng/L) 


0.05 




9.48 


7.96 




7.04 


-3.18 


0.68 


10 


4.52 


2.76 


16.1 


13.09 


5.06 


2.95 




5.23 


3.89 




10.15 


5.1 


CK 


76 


5.7 


2.19 


1.45 


5.8 


-0.05 


0.98 


(U/L) 


592 


1.96 


0.47 


-0.01 


-2.47 


DBil 


3.42 




6 


4.53 


11.4 


5.47 


-7.02 


(umol/L) 


37.63 


6 


4.91 


4.96 


-0.42 


8.11 


GGT 
(U/L) 


157 


3.5 


1.34 


0.68 


5.4 


-0.96 


-2.25 


i n 
(U/L) 


91 


4.3 


3 


4.02 


4.3 


1.33 


3.47 


Li 


0.5 


5(#) 


4.24 


3.83 


5(#) 


-1.55 


4.97 


(mmol/L) 


2.35 


1.73 


2.94 


-0.67 


0.79 




59 




7.58 


1.72 




-5.57 


-0.05 


IN 1 -prObNr 

(ng/L) 


138 


10.44 


4.5 


1.45 


10.4 


3.23 


-6.32 


2.044 




8.2 


5.1 




2.15 


1.32 


CRP 
(nmol/L) 


75.81 
1904.80 


10.55 


5.56 
5.73 


2.97 
2.6 


10.9 


7.52 
7.92 


1.17 

0.22 


TBil 
(nmol/L) 


8.55 
111.18 


6 


5.99 
2.56 


5.88 
1.48 


11.4 


-0.5 
1.14 


0.5 
4.73 


Tg 
(mmol/L) 


0.95 
2.29 


5.2 


2.73 
3.51 


5 
4.43 


5.3 


-3.07 
-5 


-0.49 
-2.84 


TP 


42.20 




1.82 


1.37 


1.8 


0.59 


0.89 


(g/L) 


67.70 


2 


1.65 


1.15 


0 


-1.14 


UricA 


207.60 


4.5 


2.42 


4.41 


4.9 


-3.41 


2.57 


(Umol/L) 


576.41 




2.78 


3.63 




0.02 


-0.96 


UCFP 

(g/L) 


240 
747.4 


19.8 


5.52 
8.04 


6.18 
8.83 


10.9 


-6.71 
-0.3 


-2.92 
1.63 
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Pools 







Imprecision (%) 






SE (%) 




Analyte 
(units) 


Pool Concentration 


_ c CV 
QS V-1 


CV 
V-2 


QS 


PD 

V-1 


PD 
V-2 


BUN 
Plasma 
(mmol/L) 


Pool A 
< 17.85 

Pool B 
>35.70 


6.2 2.15 
6.2 3.21 


3.03 
4.25 


/ 
/ 


/ 
/ 


/ 
/ 


BUN (mmol/L) 


Urine Pool 

>1 78.50 


11.4 5.68 


0.81 


/ 


/ 


/ 


UricA (Mmol/L) 


Pool A 
>416.40 


4.5 2.05 


1.13 


/ 


/ 


/ 


QS - Quality specification; SE - Systematic error; CV - Coefficient of variation; MC - Manufacture claims; PD - Percent difference related to 
expected value; # P50 EQAP, 

Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine aminotransferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate amin- 
otransferase; BUN - Urea nitrogen; Ca - Calcium; Choi - Cholesterol; CK - Creatine kinase; Cre - Creatinine; GGT - y-glutamyl transferase; LD 
- Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil - Total bilirubin; Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; 
Tg - Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total protein; K- Potassium; Na - Sodium; CI - Chloride; Li - Lithium; HCG - 
Human chorionic gonadotropin; CRP - C-reactive protein; cTNl - Cardiac troponin 1; NT-proBNP - N-terminal pro-brain natriuretic peptide. 



Table 5. Analytes within total allowable Error (TEa) in both analyzers. 



Control Material 



Analyte 
(units) 


MDL 


QS 


Imprecision (%) 

CV V-1 cv 
V-2 


QS 


SE (%) 
PDV-1 


PDV-2 


QS 


Total Error (%) 
V-1 


V-2 


Alb 

(g/U 


24.20 
38.50 


2.3 


2.26 
2.02 


2.75 
2.79 


2 


-0.4 
0.06 


1.03 
0.39 


5.8 


4.13 
3.39 


5.57 
4.99 


ALP 

(U/L) 


298 


3.2 


4.32 


2.8 


6.4 


3.93 


11 


17.52 


11.06 


15.62 


Ca 
(mmol/L) 


1.40 
3.10 


1.4 


1.80 
1.09 


1.22 
0.56 


1.3 


0.49 
0.16 


1.25 
0.4 


3.6 


3.46 
1.96 


3.26 
1.32 


Cre 
(umol/L) 


64.53 
598.47 


4 


6.25 
3.21 


3.04 
0.45 


5.7 


1.72 
0.96 


0.32 
1.19 


12.2 


12.03 
6.26 


5.34 
1.93 


Glu (mmol/L) 


3.33 
19.76 


2.9 


1.99 
1.6 


2.28 
1.44 


2.2 


0.58 
0.07 


3.07 
1.3 


6.9 


3.86 
2.71 


6.83 
3.68 


K 

(mmol/L) 


2.09 
7.11 


2.4 


2.9 
1.74 


-2.83 
0.94 


1.8 


1.02 
0.11 


0.79 

0.53 


8.7 


5.81 

2.98 


5.46 
2.08 


Phos 
(mmol/L) 


0.62 
2.20 


4.3 


2.8 
1.67 


5.35 
5.31 


3.2 


2.96 
0.48 


0.13 
0.07 


10.2 


7.58 
3.24 


8.96 
8.83 
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Table 5. Continued 



Pools 


Analyte 


Pool 


Imprecision (%) 




SE (%) 






Total Error (%) 




(units) 


Concentration 


QS 


CVV-1 


CVV-2 


QS 


PDV-1 


PDV-2 


QS 


V-1 


V-2 


Ca Plasma 


Pool A 


1.4 


1.28 


1.08 


/ 


/ 


/ 


/ 


/ 


/ 


(mmol/L) 


<2.00 


/ 


/ 


/ 


/ 


/ 


/ 




Pool A 








/ 


/ 


/ 


/ 


/ 


/ 


Cre 




4 


6.29 


4.23 


Plasma 


Pool B 




















/. 1 it \ 

(umol/L) 


4 


3.04 


3.98 


/ 


/ 


/ 


/ 


/ 


/ 




1 o.ou 




Cre 


Urine Pool 


12 


1.34 


0.47 


/ 


/ 


/ 


/ 


/ 


/ 


(Mmol/L) 


>8840.00 


Glu 


>6.11 








/ 


/ 


/ 


/ 


/ 


/ 


2.9 


1.06 


0.35 


Plasma 


(mmol/L) 




K 


Pool A <3 


2.4 


1.97 


9 


/ 


/ 


/ 


/ 


/ 


/ 


Plasma 






















(mmol/L) 


Pool B >6 


2.4 


2.80 


1.24 


/ 


/ 


/ 


/ 


/ 


/ 


UCFP 


>400 


19.8 


1.96 


8.81 


/ 


/ 


/ 


/ 


/ 


/ 


Urine (g/L) 


















MDL - Medical decision levels; QS - 


Quality specification; CV- Coefficient of variation; SE ■ 


■ Systematic error; PD - 


Percent difference related to 


expected value; Alb - Albumin; ALP - Alkali 


ne phosphatase; Ca - 


Calcium; Cre 


- Creatinine; Glu - Glucose; 


K - Potassium; Phos - Phosphorus; 



UCFP - Urinary/cerebrospinal fluid protein. 



Table 6. Analytes that need further review in both analyzers. 



Control Material 


Analyte 
(units) 


MDL 


QS 


Imprecision (%) 

CV 

CVV-1 

V-2 


QS 


SE (%) 

PD 
V-1 


PD 
V-2 


QS 


Total error (%) 

TE te 
V-1 V-2 


Na (#) 
(mmol/L) 


110 

153 


0.5 


0.58 
0.92 


0.85 
0.96 


0.5 


0.31 
-0.03 


0.54 
0.19 


1.32 


1.27 
1.55 


1.94 
1.77 


Cl(#) 
(mmol/L) 


74 
121 


0.9 


0.85 
1.27 


1.05 
1.09 


0.7 


-1.03 
-0.72 


-0.35 
-1.07 


2.21 


2.70 
2.82 


2.08 
2.87 


Mg (#) 
(mmol/L) 


0.45 

2 


2.7 


2.55 
1.79 


6.04 
1.82 


2.8 


3.03 
4.39 


2.69 
-0.03 


7.21 


7.24 
7.34 


12.66 
3.03 


Pools 


Analyte 


Pool 
Concentration 


QS 


Imprecision (%) 

CV CV 
V-1 V-2 


QS 


SE (%) 

PD 
V-1 


PD 
V-2 


QS 


Total error (%) 

TE TE 

V-1 V-2 


Na Plasma 


Pool A<120 


0.5 


1.21 


1.23 


/ 


/ 


/ 


/ 


/ 


/ 


(mmol/L) 


Pool B >145 


0.5 


1.19 


1.13 


/ 


/ 


/ 


/ 


/ 


/ 


CI 


Pool A <90 


0.9 


1.6 


1.24 


/ 


/ 


/ 


/ 


/ 


/ 


Plasma 
(mmol/L) 


PoolB>110 


0.9 


1.34 


1.44 


/ 


/ 


/ 


/ 


/ 


/ 



MDL - Medical decision levels; QS - Quality specification; CV - Coefficient of variation; SE- Systematic error; PD- Percent difference related to ex- 
pected value; Na - Sodium; CI - Chloride; Mg - Magnesium. # Manufacturer claim (MC): Sodium MC for imprecision: 4.5 % at 120 mmol/L and 2.99% 
at 164 mmol/L. Chloride MCfor imprecision: 4.24% at 99 mmol/L and 3.98% at 123 mmol/L. Magnesium MCfor imprecision: 9.58% at 1.05 mmol/L 
and 12.38% at 5.25 mmol/L. 
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over preventive maintenance, improving calibra- 
tor stability by changing its storage conditions 
(frozen versus refrigerated) and even more, cali- 
brator value was reassigned by the manufacturer. 

Nevertheless, these three parameters (sodium, 
chloride and magnesium) fulfilled manufacturer 
claims (Table 6) and the Spanish minimum consen- 
sus quality specifications (17). 

On the other hand, the verification of comparabili- 
ty of patient results is shown in Table 7. 

All the parameters performed by the same meth- 
odology were interchangeable with the previous 
device, except magnesium in which significant dif- 
ferences were found. Analytical conditions and 
reference intervals were reviewed, showing no ad- 
ditional problems. Finally this issue was solved as 
the manufacturer changed the calibrator assigned 
value after conducting an interim review process. 
The change was intended to better align the Di- 
mension Vista magnesium results with the refer- 
ence method, atomic absorption, particularly at 
the low end of the assay range (Siemens HD Sup- 
port Bulletin DV-1034_MG Dimension Vista® CHEM 
1 Calibrator). 

The parameters with methodological changes 
such as cTNl, NT-proBNP and CRP obviously 
showed that patient results were not interchange- 
able. 

Discussion 

Patients belonging to a healthcare system, at some 
stage within their life, may encounter different sys- 
tems of measurements within the same institution. 
This may be the case even during a single clinical 
event. It forces the laboratory, as a critical point, to 
control and ensure that all the results that may be 
issued are comparable (18). In addition to this, the 
laboratory must ensure that they are incorporated 
into each patient's medical record, without distort- 
ing or creating errors which may affect the inter- 
pretation of their results (19) and CLSI recommends 
to control this aspect as a means of risk manage- 
ment (6,7). 

In addition, this represents an ISO 15189:2007 re- 
quirement and accreditation bodies must review 
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that laboratory had performed all the necessary 
mechanisms to ensure this issue. 

The flexible scope in the accreditation process 
(2-4) implies that laboratory assume responsibility 
for the management of all or part of its scope of 
accreditation without the necessity of a prelimi- 
nary evaluation by the Accreditation Body for each 
new activity. For which reason, the laboratory 
must demonstrate to the accreditation body that 
it has the technical competence in evaluating 
methods prior to use on patient samples. As an ac- 
credited laboratory this enables it to incorporate a 
new test into its accredited scope on the basis of 
its own validations without waiting for the evalua- 
tion by the accreditation body prior to the next 
audit or having to undergo an extraordinary audit. 

The strength of the flexible scopes of accreditation 
is based on the capability of the laboratory's man- 
agement system on the implementation of the 
validation and/or verification procedures and the 
monitoring activities related to their implementa- 
tion (appropriateness of claims, personnel compe- 
tence, estimations of measurement uncertainty, 
equipment and measurement traceability, profi- 
ciency testing activities and internal quality con- 
trol). 

In this context accreditation body evaluation is fo- 
cused on laboratory validation activities. That im- 
plies that the laboratory has to develop a well or- 
ganized and documented procedure of validation 
of the measurement system so that it could be 
able to demonstrate the adequacy of the system 
in an easy and reproducible way. This is very im- 
portant in order to shorten the time of evaluation 
and reducing the impact of the economical and 
human resources expenses, increasing the labora- 
tories' effectiveness. 

On the other hand, the main objective of the labo- 
ratory is to serve as a diagnostic tool as well as 
monitoring a treatment or a disease evolution. In 
this context, it is necessary to ensure that the ana- 
lytical quality of the results fulfil their clinical 
needs. Our laboratory established biological varia- 
tion as the criteria which enable this (12). 

Nevertheless, all procedures to guarantee analyti- 
cal quality should be performed in a standardized 

Biochemia Medica 2013;23(l):83-95 



91 



Fernandez-Calle P. et al. 



Validation procedure in a flexible scope ISO 15189 



Table 7. Verification of comparability of patients results with the previous device. 



Analyte (units) 




Allowable 


Estimated 






Allowable 


(measuring 


MDL 


difference 


difference 


95% CI 


difference 


range) 




(%) 






at MDL 




20 




0.4 


0.2 


0.7 


1.2 


Alb (g/L) 


35 


5.90 


-0.4 


-0 7 


-0 1 


2.1 


(9-53) 
















52 




-1.4 


-2.0 


-0.7 


3.1 


Al P (\ l/l ^ 
MLr yJI\-) 














400 


17.52 


-68.0 


-74.1 


-61.8 


70.1 
















ALT fl U/L) 


60 


16 


-7.8 


-10.4 


-5.3 


9.6 


(9-529) 


3nn 

JUU 




i i 
i . i 


-4.5 


6.7 


n 


Amon ([jmol/L) 


91 


10 


7.1 


-5.5 


19.8 


9.1 


(46-390) 


365 




-5.9 


-11.3 


-0.6 


36.5 




50 




-4.3 


-7.3 


-1.4 


7.3 


AMY (U/L) 














120 


14.6 


-9.7 


-12.6 


-6.8 


17.5 


(5-1513) 
















200 




-15.8 


-18.7 


-12.9 


29.2 


AST (I U/L) 


60 


15.2 


-4.7 


-6.3 


-3.1 


9.1 


(4-491) 


300 


-5.2 


-10.1 


-0.2 


45.6 


l l /" / — /Jt\ /II i ii \ 

HCGn (IU/L) 


5 


5.20 


-0.2 


-2.5 


2.1 


0.3 


(0-30919) 


604 




8.1 


3.8 


12.5 


31.4 




4.6 




0.5 


0.2 


0.8 


0.7 


BUN (mmol/L) 


19.9 


15.70 


0.1 


-0.1 


0.3 


3.1 


(4.6-58.2) 
















JO.Z 




-n a 


-0.9 


0.1 


ft 0 
o.u 




1 7^ 
1 ./J 




U.Uj 


-0.00 


0.06 


n nft 
u.uo 


Ca (mmol/L) 














2.75 


3.6 


-0.07 


-0.09 


-0.04 


0.10 


(1.73-3.40) 
















3.38 




-0.12 


-0.14 


-0.10 


0.12 




2.33 




0.0 


-0.1 


0.1 


0.2 




5.18 




-0.2 


-0.2 


-0.1 


0.4 


Choi (mmol/L) 


6.22 


8.5 


-0.2 


-0.3 


-0.2 


0.5 


(1.30-9.12) 
















6.73 




-0.3 


-0.4 


-0.2 


0.6 




9.07 




-0.4 


-0.6 


-0.3 


0.8 




100 




0.9 


-5.1 


6.9 


15.2 


CK (U/L) 


240 


15.2 


-8.5 


-14.0 


-2.9 


36.5 


(6-2198) 
















1800 




-113.2 


-140.4 


-85.9 


273.6 


CI (mmol/L) 


90 


2.2 


-1.4 


-3.5 


0.7 


2.0 


(90-120) 


112 




-1.1 


-2.0 


-0.3 


2.5 


cTNl (*) (ug/L) 














0.045 


10.00 


0.03 


0.24 


0.19 


0.01 


(0.000-31.750) 
















53 




5.3 


3.6 


7.1 


5.6 


Cre (umol/L) 


141 


12.24 


7.2 


5.7 


8.9 


15.0 


(42-1591) 
















530 




15.8 


9.4 


22.2 


56.0 



Analwta limitcl 
MIldlyLtr lUflllaJ 




A 1 1 f\\m a h 1 a 


Estimated 






nliuwduic 


(measuring 


MDL 


difference 


difference 


95° 


&CI 


difference 


range) 




(%) 






at MDL 




20 




-2.1 


-6.3 


2.2 


2.2 


CCT (\ l/l \ 














50 


11.10 


2.9 


-6.8 


1.0 


5.6 


P OODJ 
















150 




5.7 


-9.2 


-2.3 


16.7 




2.50 




-0.09 


-0.25 


0.07 


0.17 


Glu (mmol/L) 














6.66 


6.90 


-0.13 


-0.19 


-0.06 


0.46 


(2.39-12.21) 
















9.99 




-0.16 


-0.28 


-0.03 


0.69 




3.0 




0.01 


-0.02 


0.04 


0.17 


[\ \\\\\\\\J\i \-) 














5.8 


5.8 


-0.20 


-0.24 


-0.17 


0.34 


(~) A ~I Q\ 
















7.5 




-0.33 


-0.40 


-0.27 


0.44 




150 




-2.1 


-11.7 


7.6 


17.1 


i n (\ i/i i 

L-L/ \\J/ L) 














300 


11.40 


-20.5 


-28.1 


-12.9 


34.2 


[ \\J3-/oO) 
















500 




-45.1 


-58.2 


-32.0 


57.0 


Mg (#) 


0.60 
(#) 




0.10 


0.08 


0.12 


0.04 


r m rr\ r\ 1 /I i 
^ITIITIOI/ 




7 ir\ 










1.00 


0.06 


0.05 


0.08 


0.07 


(0.55-2.50) 
















2.50 




-0.07 


-0.08 


-0.05 


0.18 




115 




1.3 


0.7 


1.9 


1.5 


Ma fmmnl /I 1 

in a tmmoi/Lj 


135 


1.30 


-0.3 


-0.9 


0.3 


1.8 


\ \ \ Z 1 Jt] 
















150 




-1 .5 


-2.5 


-0.4 


1 .9 


NT-proBNP (*) 


125.0 




109.5 


26.0 


193.1 


34.5 


(ng/L) 


450.0 


27.60 


162.1 


85.0 


239.2 


124.2 


(4.0-7379.8) 


2985.1 




571.8 


444.5 


699.1 


823.9 




285.7 




73.1 


-179.4 


325.4 


161.7 


L.Kr tnmoi/Lj 














952.4 


56.6 


93.8 


-143.8 


331.44 


539.1 


(19.1-10502.9) 
















9524.0 




361.3 


174.4 


548.11 


5390.6 




0.48 




-0.05 


-0.06 


-0.03 


0.05 


Phos (mmol/L) 














0.81 


10.20 


-0.04 


-0.05 


-0.03 


0.08 


















1.62 




-0.03 


-0.04 


-0.00 


0.16 




24.0 




-0.7 


-1.0 


-0.3 


3.7 


TBil (umol/L) 


42.8 


15.50 


-1.6 


-2.0 


-1.2 


6.6 


(3.4-345. 1 ) 
















342.1 




-16.4 


-19.3 


-13.4 


53.0 


Tg (mmol/L) 


1.69 


14.00 


0.15 


0.12 


0.18 


0.24 


(0.46-4.60) 


4.52 




0.23 


0.15 


0.32 


0.63 




45 




-0.7 


-1.5 


0.1 


2.3 


TP (g/L) 


60 


5.20 


-0.7 


-1.0 


-0.3 


3.1 


(42-81) 
















80 




-0.6 


-1.5 


0.2 


4.2 




119.0 




-4.9 


-8.9 


-1.0 


14.8 


UricA (umol/L) 


475.9 


12.40 


-1.6 


-19.2 


-7.7 


59.0 


(83.3-690.0) 
















636.5 




-17.3 


-29.0 


-7.9 


78.9 



(*) Methodological changes and non interchangeable results. 
# Non-interchangeable. 

MDL - Medical decision levels; PD - Percent difference related to expected value; Alb - Albumin; ALP - Alkaline phosphatase; ALT - Alanine amin- 
otransferase; Amon - Ammonia; AMY - Amylase; AST - Aspartate aminotransferase; BUN - Urea nitrogen; Ca - Calcium; Choi - Cholesterol; CK - Cre- 
atine kinase; Cre - Creatinine; GGT - y-glutamyl transferase; LD - Lactate dehydrogenase; UricA - Uric acid; DBil - Direct bilirubin; TBil - Total bilirubin; 
Phos - Phosphorus; Glu - Glucose; Mg - Magnesium; Tg - Triglycerides; UCFP - Urinary/cerebrospinal fluid protein; TP - Total protein; K - Potassium; Na 
- Sodium; CI - Chloride; Li - Lithium; HCG - Human chorionic gonadotropin; CRP - C-reactive protein; cTNl - Cardiac troponin I; NT-proBNP - N-terminal 
pro-brain natriuretic peptide. 
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way. For every kind of evaluation our studies fol- 
low the CLSI protocols, recognized worldwide. This 
includes EP5 for imprecision, EP15 for bias estima- 
tion and EP9 for method comparison. 

One of the remarks that CLSI highlights in these 
studies is the kind of selected material. It is recom- 
mended to be as similar as possible to patient 
samples. The other remarkable need is the con- 
centration at which clinical decision is made. They 
should be as near as possible to the medical deci- 
sion levels. Samples selected in our studies are 
quality control material from human matrix and 
they are complemented with patient samples 
pools from plasma or urine for some parameters 
of interest. All comparison studies were performed 
on patient samples. 

The medical literature deals with these kinds of is- 
sues by approaching only a few parameters at one 
time (20-22). Other studies only deal with a single 
analytical performance evaluation (23,24). There 
are not many articles that include all routine bio- 
chemistry parameters in the same procedure 
(25,26) covering the main evaluation protocols. On 
the other hand, the majority of studies set the 
manufacturer claims as quality objectives (25-27). 
Biological variation which constitutes the analyti- 
cal objectives of our study is generally more strin- 
gent than manufacturer claims (28). 

Related to the evaluation of analytical perform- 
ance of Dimension Vista, 27 of 30 studied parame- 
ters fulfilled all analytical criteria. Even though 7 of 
them did not reach the desired imprecision or bias, 
all were less than TEa, therefore all were consid- 
ered within acceptance criteria. 

If an analyte shows results greater than the allow- 
able imprecision or bias, but are less than the total 
allowable error (the maximum acceptability limit 
for laboratory), it could be considered acceptable. 

The 3 parameters that did not fulfil the analytical 
requirements (sodium, chloride and magnesium) 
needed further evaluations and actions before be- 
ing used on clinical patients. All fulfilled manufac- 
turer claims and also the minimum consensus ana- 
lytical specifications derived by the "state of the 
art" that has been published, as well as other well 
known specifications (17,29-31). As previously de- 
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scribed, these actions included changes in mainte- 
nance protocols, review of water supply condi- 
tions, changes in storage conditions of calibrators 
and reassignation of calibrator values. 

Due to the thorough nature of the study, we were 
able to highlight some analytes with poor analyti- 
cal performance that otherwise could be over- 
looked. This is one of the main benefits from the 
study since we could apply a more stringent quali- 
ty control strategy over these parameters, having 
a positive impact on clinical practice. 

On the other hand, this study considers the use of 
biological variation criteria as an analytical quality 
objective instead of using other wider objectives. 
Depending on the laboratory resources and the 
"state of the art", some of these quality specifica- 
tions might be unrealistic. If the actual objective is 
not achievable in a long term monitoring, after 
acting in a corrective way, it is important to con- 
sider the possibility of changing the quality objec- 
tive. In that case, if the chosen objective is down in 
the Stockholm hierarchy, the laboratory must as- 
sume that the level of quality necessary to satisfy 
medical needs may not be fulfilled. 

This was not our case because TEa biological varia- 
tion specifications were mostly reached, as was 
confirmed in the monthly laboratory periodic eval- 
uations. 

All parameters included in the new technological 
improvement (LOCI) (32) obtained better analyti- 
cal performance than previous methodologies: 
cTNl, NT-proBNP as well as CRP by nephelometri- 
cal assay. 

Regarding these parameters, some changes have 
been made. For instance, a new 99 Percentile cut- 
off for cTNl was established (0.04 ng/mL) highlight- 
ing that imprecision less than 1 0% can be obtained 
for this cut-off (33,34). Clinicians were alerted 
about this new diagnostic point by means of multi- 
disciplinary clinical seminars, written warnings, 
etc. 

Regarding the verification of comparability of pa- 
tient results with the previous device, all parame- 
ters performed by similar methodologies were in- 
terchangeable, except magnesium. 
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In the case of magnesium, significant differences 
were found at the medical decision levels for hy- 
pomagnesaemia diagnosis which is relevant in 
children with kidney transplant for instance. Clini- 
cians were alerted about the possibility of new ref- 
erence population values and advised that every 
individual patient should have been carefully ana- 
lyzed and compared with their historical record. 
Finally, the problem was solved with the new cali- 
brator assigned value by the manufacturer. 

These evaluations illustrate that even same meth- 
odology and same manufacturer can give non-in- 
terchangeable patient results. In addition, a differ- 
ent device of the same model can produce differ- 
ent analytical performance. 

In summary, a new device installation should al- 
ways be validated by the laboratory due to the fact 
that different working conditions can influence pa- 
tient results. This kind of evaluation procedure 
should always be performed prior to use on pa- 
tient samples. Therefore, laboratory can demon- 
strate some limitations that otherwise could be 
overlooked. 

Dimension Vista showed a generally good accept- 
able analytical performance according to biologi- 



cal variation criteria but technical supervising 
should be necessary for some parameters such as 
sodium or chloride. Some other parameters met 
biological variation criteria except at the medical 
decision levels (creatinine, magnesium) and would 
require the application of extreme quality control 
procedures. 

The benefit of having a flexible scope of accredita- 
tion is to be able to include additional or new ac- 
tivities as accredited from the first patient result. In 
that way it is not necessary to be previously evalu- 
ated by the Accreditation Body. Laboratories hav- 
ing flexible scopes can reduce the economical im- 
pact of technical innovations increasing their labo- 
ratory effectiveness. 
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